As Windows 10 Support Ends, Microsoft Is'Rewriting' Windows 11 Around AI All Windows 11 users will soon be able to talk to the Copilot AI assistant more easily via voice, and Copilot Vision can understand the context of your screen. Microsoft saved its most powerful AI tools for paying customers in the first phase of its AI evolution. Now, the company has announced a series of Copilot features coming to all Windows 11 PCs, including Voice, Copilot Vision, and Copilot Actions. Alongside the update, Microsoft is launching an ad campaign to expose people to these new features. Windows 10 support ended on October 14, and we're about to see a wave of people upgrade to Windows 11; Microsoft seems intent on putting advanced Copilot features at the fingertips of as many people as possible--and convincing them they're worth using.

When you purchase through links in our articles, we may earn a small commission. Microsoft's Copilot AI technologies will be able to see more and connect to a greater range of files. Copilot Vision's eyesight is improving, as the integrated Windows AI technology will soon be able to see entire documents, plus link to apps like Google Drive via a new connectors function. Separately, Microsoft is adding Copilot to the Windows 11 taskbar and making "Hey Copilot" a wake word for the Windows AI app. It's part of the company's effort to expand its presence across your PC.

When you purchase through links in our articles, we may earn a small commission. Microsoft wants to redefine the Windows AI PC. Copilot Actions is the first step. Microsoft's Copilot Actions is what happens when Microsoft begins rethinking the future of Windows and how AI is integrated into the operating system. Imagine agentic AI being turned loose inside your PC and performing tasks without your supervision.

The rapid development of artificial intelligence (AI) has unearthed the potential to assist humans in controlling advanced technologies.

The rapid development of artificial intelligence (AI) has unearthed the potential to assist humans in controlling advanced technologies. Shared autonomy (SA) facilitates control by combining inputs from a human pilot and an AI copilot. In prior SA studies, the copilot is constantly active in determining the action played at each time step. This limits human autonomy and may have deleterious effects on performance. In general, the amount of helpful copilot assistance can vary greatly depending on the task dynamics. We therefore hypothesize that human autonomy and SA performance improve through dynamic and selective copilot intervention. To address this, we develop a goal-agnostic intervention assistance (IA) that dynamically shares control by having the copilot intervene only when the expected value of the copilot's action exceeds that of the human's action across all possible goals. We implement IA with a diffusion copilot (termed IDA) trained on expert demonstrations with goal masking. We prove a lower bound on the performance of IA that depends on pilot and copilot performance. Experiments with simulated human pilots show that IDA achieves higher performance than pilot-only and traditional SA control in variants of the Reacher environment and Lunar Lander. We then demonstrate that IDA achieves better control in Lunar Lander with human-in-the-loop experiments. Human participants report greater autonomy with IDA and prefer IDA over pilot-only and traditional SA control. We attribute the success of IDA to preserving human autonomy while simultaneously offering assistance to prevent the human pilot from entering universally bad states.